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BACKGROUND 



Field of the Invention 

[0001] The present invention relates to techniques for allocating memory 
within a computer system. More specifically, the present invention relates to a 
method and an apparatus for redirecting external memory allocation operations tc 
an internal memory manager in order to better control the allocation of memory 
within a computing device. 



Related Art 

[0002] The rapid growth of the Internet, coupled with the increasing 
availability of wireless data networks, has led to an explosion in the number of 
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Internet-connected devices. Virtually all devices that contain microprocessors are 
being connected to the Internet, including cell phones, PDAs, and personal 
communicators (cell phone/PDA hybrids). These devices are typically small in 
size to facilitate portability, which results in limited resources. Most devices in 
5 this category are memory-constrained, and hence contain limited storage space. 

[0003] Due to the memory-constrained nature of these devices, effective 
memory management, including garbage collection, is critical to their operation. 
However, creating virtual machines for these memory-constrained devices that 
facilitate effective memory management is a challenging task. 
10 [0004] When programming on top of existing "external" system layers 

that allocate memory, the programmer has no control over external memory 
management. In this case, memory fragmentation is highly likely, which can lead 
to memory exhaustion and the premature termination of executing programs due 
to lack of memory. 

1 5 [0005] To remedy this problem, it is possible for a programmer to allocate 

data structures in a garbage-collected heap. This allows a compacting garbage 
collector to be used to reduce memory fragmentation. For data structures that 
cannot be easily allocated on the garbage-collected heap, a programmer can avoid 
making calls to an external memory manager, and can instead call internal 
20 memory allocation code, which can be tuned to avoid memory fragmentation. 

[0006] Unfortunately, the above-described techniques but cannot be used 
in all situations. For example, memory that is allocated by external libraries is 
outside of the control of the application. Consequently, the programmer is not 
able to either allocate this memory on the garbage-collected heap or to use internal 

25 memory allocation code. 

[0007] What is needed is a method and an apparatus for efficiently 
managing memory that is allocated externally without the problems listed above. 
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SUMMARY 

[0008] One embodiment of the present invention provides a system that 
facilitates redirecting external memory allocation operations, generated during 
calls by an application to external library functions, to an internal memory 
5 manager within the application. The system starts by encountering a call to an 
external library function during execution of the application. The system then 
determines if the external library function can call an internal memory allocation 
function, and if so, redirects the call to an internal memory allocation function 
within the application. 
1 0 [0009] In a variation on this embodiment, the task of determining if the 

external library function can call an internal memory allocation function involves 
reading a pre-determined indicator value, which indicates whether the external 
library function can call an internal memory allocation function. 

[0010] In a further variation on this embodiment, the system pre-computes 
1 5 a value for the pre-determined indicator value by examining the external library 
function to determine whether the external library function or a function called by 
the external library function will call a memory allocation function, and whether 
there are problematic references to external memory blocks allocated by the 
external library function. 
20 [001 1] In a variation on this embodiment, the application is a platform- 

independent virtual machine. 

[0012] In a variation on this embodiment, the application runs in single- 
threaded mode on a computing device. 

[0013] In a variation on this embodiment, the application runs on a 
25 memory-constrained computing device. 



3 

Attorney Docket No. SUN-P9039-EKL Inventors: Mathiske et al. 

DMG H:\SUN MICROSYSTEMS\SUN-P9039-EKL\SUN-P9039-EKL APPLICAT10N.DOC 



10 



,00141 inavariationonthisembodimenuedirecungthecalltothe 

calls the internal memory allocation function. 

,00151 In a variation on mis embodiment, the system periodrcally 

allocation function. „i motion 

(0016, In a variation on this embodiment, me internal memory allocatton 

function allocates memory in a heap. 

BRIEF DESCRIPTION OF THE FIGURES 
[00171 FIG. 1 illustrates a computing device in accordance with an 
embodiment of the present invention. 

,00181 FIG. 2 illustrates data sttucrured involved in the garbage collect 
pr „cess in accordance with an embodiment of me present inventton. 
15 ,0019, FIG. 3 presents a flowchart illustrattng the process of reduce* 

extemalmemoryalloeationoperationstnaecordancewrmanembodimentofflte 

2 „ iroryLationopemtiontn — withanemboutmentofmepresen, 
invention. 

DETAILED DESCRIPTION 
,0021, The following description is presented to enable any person skilled 
25 m me L to make and use me invention, and is provided in the context o a p*«- 
ctappflcationanditsre^rements. Various modifications to me dtselosed 
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principles defined herein may be applied to other embodiments and applications 
without departing from the spirit and scope of the present invention. Thus, the 
present invention is not intended to be limited to the embodiments shown, but is 
to be accorded the widest scope consistent with the principles and features 

5 disclosed herein. 

[0022] The data structures and code described in this detailed description 
are typically stored on a computer readable storage medium, which may be any 
device or medium that can store code and/or data for use by a computer system. 
This includes, but is not limited to, magnetic and optical storage devices such as 

10 disk drives, magnetic tape, CDs (compact discs) and DVDs (digital versatile discs 
or digital video discs), and computer instruction signals embodied in a 
transmission medium (with or without a carrier wave upon which the signals are 
modulated). For example, the transmission medium may include a 
communications network, such as the Internet. 

15 

rnm pntinp Device 

[0023] FIG. 1 illustrates a computing device 100 in accordance with an 

embodiment of the present invention. Computing device 100 can generally 

include any type of computer system, including, but not limited to, a computer 
20 system based on a microprocessor, a mainframe computer, a digital signal 

processor, a portable computing device, a personal organizer, a device controller, 

and a computational engine within an appliance. 

[0024] Computing device 100 includes an operating system 105 and 

native libraries 104, which support execution of virtual machine 102. Virtual 
25 machine 102 can include any platform-independent virtual machine. In one 

embodiment of the present invention, virtual machine 102 is a JAVA VIRTUAL 
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MACHINE (JVM). The terms JAVA, JVM, and JAVA VIRTUAL MACHINE 
are trademarks of SUN Microsystems, Inc. of Santa Clara, California. 

[0025] Native library 104 contains system code that is external to virtual 
machine 102. For example, this system code can implement functions related to 
the operating system (OS) or to a graphical user interface (GUI). 

[0026] Code within virtual machine 102 and native library 104 can 
allocate and operate on data structures in garbage-collected heap 106 as well as 
native memory 108, which is outside of garbage-collected heap 106. 

Internal Memory Man agement 

[0027] In order to gain control of memory management operations, an 
interpose function from an interpose library can be used to override the native 
memory allocation function with a new internal memory allocation function. This 
new internal memory allocation function can allocate memory from a pool that is 
managed by virtual machine 102. Note that an application, such as a virtual 
machine, can have all of its function calls intercepted by pre-linking to an 
interpose library created for the purpose of intercepting the function calls. Pre- 
linking refers to the process of dynamically linking a library to a program during a 
run-time invocation. This pre-linking is performed on a program that has already 
been compiled and linked into an executable file. In this way, the internal 
memory allocation functions of the present invention can be applied to any 
executable code, without having to modify or re-link the executable code. 

[0028] Since the present invention allows memory to be allocated and 
managed internally, it is possible to modify existing garbage collection 
mechanisms to avoid memory fragmentation problems. For example, referring to 
FIG. 2, the root set of a garbage collector can be augmented to include pointers to 
memory objects that are allocated through in native memory 108. The garbage 
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collector operates on objects within garbage-collected heap 106 as usual. While 
operating on objects located in native memory 108 (outside of garbage-collected 
heap 106), the garbage collector must take into account the fact that pointers to 
these objects may skip the object headers (as is illustrated in FIG. 2) while 
5 manipulating pointers during garbage collection operations on these objects. 

[0029] Note that the above-described technique only works if the system 
avoids performing garbage collection operations while the objects being garbage- 
collected are being referenced by another process. Hence, the above-described 
technique generally works for virtual machines running on uniprocessor systems 
10 that do not provide preemptive scheduling inside or below the virtual machine 
layer. 

P ^^n r F*ternalMei ' MlocatioB Operations 

[0030] FIG. 3 presents a flowchart illustrating the process of redirecting 
15 external memory allocation operations in accordance with an embodiment of the 
present invention. 

[0031] Before the execution of the application, a programmer determines 
whether a native library can make use of an internal memory allocation function 
to allocate memory (step 302). The programmer does this by determining if the 
20 library allocates memory. If so, the programmer determines if the allocated 
memory is used in a way that complicates garbage collection. For example, if 
there are external references to the allocated memory blocks, the memory blocks 
can be modified by external code, and hence cannot be controlled by an internal 
memory manager. If the native library does not allocate memory, or does so in a 
25 way that does not complicate internal garbage collection, the programmer sets an 
allocation redirect variable for the function. 
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[0032] The application is them pre-linked with an interpose library created 
for the purpose of intercepting the function calls (step 304). This causes any calls 
to a memory allocation function to be intercepted by an interpose memory 
allocation function. 

5 [0033] Next, during program execution, the system encounters a call to a 

native library function (step 306), and the system calls to the native library 
function (step 306). If the native library function does not cause a call to the 
memory allocation function, the system returns to step 306 to continue executmg 
the program. 

10 [0034] Otherwise, the native library function causes the interpose memory 

allocation function to be called. This interpose memory allocation function 
determines the value of the allocation redirect variable for the function set in step 
302 (step 312). If the allocation redirect variable is set, the system invokes the 
new internal memory allocation function (step 316) and returns to step 304. 
Otherwise, the system invokes the original memory allocation function (step 3 1 4) 

and returns to step 304. 

[0035] For example, referring to the pseudo-code in Table 1 below, a new 
"malloc" function called by the native library first performs a lookup for an 
original system malloc function, if the pointer to the original function is NULL. 
Next if a redirect switch is set, the application calls internal code within the 
application to perform the allocation operation. Otherwise, the system calls the 
original system malloc function. 
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static void* (*orig) (size_t) 
malloc (params) { 

if orig==NULL) { 

orig=lookup ("malloc") ; 

} * , v , 

if (redirect_switch==l) I 

execute internal allocation code 

else return (*orig) (params) ; 
LJ 



Table 1 

[0036] The foregoing descriptions of embodiments of the present 
invention have been presented for purposes of illustration and description only. 
They are not intended to be exhaustive or to limit the present invention to the 
forms disclosed. Accordingly, many modifications and variations will be apparent 
to practitioners skilled in the art. Additionally, the above disclosure is not 
intended to limit the present invention. The scope of the present invention is 
defined by the appended claims. 
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